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Abstract 

We establish a refined version of the Second Law of Thermodynamics for Langevin stochastic processes 
describing mesoscopic systems driven by conservative or non-conservative forces and interacting with 
thermal noise. The refinement is based on the Monge-Kantorovich optimal mass transport. General 
discussion is illustrated by numerical analysis of a model for micron-size particle manipulated by optical 
tweezers. 



I. INTRODUCTION 

In recent years an increased interest in fluctuations of mesoscopic systems interacting with noisy envi- 
ronment has led to the development of "Stochastic Thermodynamics" that revisited relations between 
thermodynamical princi ples and statistical description within simple models based on stochastic dif- 
ferential equations, see [33l |34| and references therein. The aim of this note is to make a junction 
between two circles of ideas in the context of Stochastic Thermodynamics of systems whose evolu- 
tion is described by the overdamped Langevin equation. One circle concerns the versions |T3 , l20l | of 
the Second Law of Thermodynamics and of its reformulation in the framework of Thermodynamics 
of Computation by Landauer 0, [26[. The other circle deals with the optimal control problems in 
Stochastic Thermodynamics that were recently connected in [l[ to the Monge-Kantorovich optimal 
mass transport and the Burgers equation. The result of the junction will be a refinement, relevant 
for fast processes, of the Second Law of Stochastic Thermodynamics. Our improvement of the Second 
Law does not go in the direction of a better control of fluctuations of thermodynamical quantities 
(35j . as do various Fluctuation Relations studied intensively in last years, see [H], Olllj]. Instead, it 
establishes the optimal lower bound on the total entropy production in non-equilibrium processes of 
fixed duration. 

The paper is organized as follows. In Sec.|TTl we define for overdamped Langevin evolution with 
conservative driving forces the concepts of performed work, heat release, and entropy production, 
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and we recall the basic laws of Stochastic Thermodynamics. Sec. lIIII contains a brief discussion of 
the relation between the Second Law of Thermodynamics and the Landauer principle. In Sec. lIVl we 
replace the minimization of the total entropy production in overdamped Langevin processes that inter- 
polate in a fixed time window between given statistical states by a minimization problem considered 
by Benamou-Brenier in Q and shown there to be equivalent to the Monge-Kantorovich optimal mass 
transport problem that is the subject of Sec.[V] The latter two sections briefly review the classical 
mathematical results about the optimal mass transport [36| needed in our argument. In particular, 
the approach of [|| establishes a direct connection between the Monge-Kantorovich problem and the 
inviscid Burgers equation for potential velocities that plays a crucial role below. On the basis of the 
above results, we establish in Scc. lVII thc refined version of the Second Law of Stochastic Thermody- 
namics, applying it to the example of Gaussian processes considered already in a similar context in 
[1] and, in a special case, in [30| . Sec. lVIII discusses the corresponding refinement of the Landauer 
principle, illustrating it by the numerical analysis of a simple model of a micron-size particle in time- 
dependent optical traps. Sec. I Villi extends the refined Second Law to the case of Langevin evolutions 
with non-conservative forces, showing that the preceding analysis covers also that case. Conclusions 
and remarks about open problems make up Sec. lIXI 

Acknowledgements. K.G. thanks S. Cilibcrto and U. Seifert for inspiring discussions. His work 
was partly done within the framework of the STOSYMAP project ANR-11-BS01-015-02. R.M.'s work 
was partly supported by the OTARIE project ANR-07-BLAN-0235. P.M.-G. acknowledges support of 
the Center of Excellence "Analysis and Dynamics" of the Academy of Finland. 



II. STOCHASTIC THERMODYNAMICS FOR LANGEVIN EQUATION 

We consider small statistical-mechanical systems, for example composed of mesoscopic particles, driven 
by time-dependent conservative forces and interacting with a noisy environment. The temporal evo- 
lution of such a system my often be well described by the overdamped stochastic Langevin equation 

dx = -MVU(t,x)dt + dC(t) (2.1) 

in d-dimensional space of configurations, with a smooth potential U(t,x) and a white noise dC{t) 
whose covariance is 

(d( a (t)d( b (t')) = 2D ab 5{t-t')dt, (2.2) 

where ( — ) denotes the expectation value. The mobility and diffusivity matrices M = (M ab ) and 
D = (D ab ) occurring above are assumed positive and ^-independent (the latter assumption is for the 
sake of simplicity and could be relaxed at the cost of few corrective terms) . To assure that the noise 
models the thermal environment at absolute temperature T, we impose the Einstein relation 

D = k B TM, (2.3) 

where k B is the Boltzmann constant. Potentials Ut(x) = U(t,x) are assumed to be sufficiently 
confining so that the solutions of the stochastic equation (|2.1[) do not explode in finite time. Given 
a probability density Pi{x) at the initial time t = 0, they define then for t > a, in general 
non-stationary, Markov diffusion process x(t). The relation 

±(g(x(t)) = ((L t g)(x(t)), (2.4) 

holding for smooth functions g(x), determines the 2 nd order differential operator 

L t = -(VUt)- A/V + k B TV ■ MV , (2.5) 

the (time-dependent) generator of diffusion x(t). The instantaneous distributions of the process, 
describing its statistical properties at fixed times, are given by the probability densities 

p(t, x) = ( 6(x - x(t)) ) = exp [ - , (2.6) 

that we assume smooth, positive, and with finite moments. They evolve according to the Fokker-Planck 
equation 



d t p = L]p, (2.7) 
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where L\ is the 2 nd order differential operator adjoint to L t . Explicitly, 



t 



V ■ M{VU t ) + k B TV ■ MV . (2.8) 



In what follows, it will be crucial that the Fokker-Planck equation (|2.7[) may be rewritten as the 
advection equation 

d t p+V -{pv) = (2.9) 

in the deterministic velocity field 

v(t,x) = -M (VU + k B T p~ l V p){t,x) = -MV{U - R){t,x). (2.10) 

The time-dependent vector field v{t, x), called current velocity in [29j], has the interpretation of the 
mean local velocity of the process x{t) defined by the limiting procedure 

\ r {6{x-x{t)){x{t + e)-x{t-e))) 

v(t,x) = hm ; r '- (2.11) 

' e->o 2e(S{x-x{t))) V ' 

(the limit has to be taken after the expectation as the trajectories of the diffusion process are not 
diffcrentiable). 

The setup of Langevin equation permits simple definitions of thermodynamical quantities. The 
fluctuating (i.e. trajectory-dependent) work performed on the system between initial time t = and 
final time t = tf is given by the Jarzynski expression [22J 

W = f f d t U(t,x(t))dt (2.12) 
J o 

and the fluctuating heat released into the environment during the same time interval by the formula 



Q = - I VU(t,x(t))-odx{t) (2.13) 

with the Stratonovich stochastic integral (symbolized by "o"). The expectation value of work is then 
given by the identity 

(W) = J'dt J d t U(t,x) p(t,x)dx, (2.14) 

where dx denotes the standard c£-dimensional volume element. In order to calculate the expectation 
value of heat release, one rewrites the definition (|2.13l) in terms of the Ito stochastic integral, including 
a corrective term: 

Q = - I ' 'vU(t,x(t))- dx{t) - k B T I '' V • MVU(t,x(t)) dt 
t t 
= I ({VU)- M(VU) - k B T(V ■ MVU))(t,x(t)) dt - [ VU{t, x{t)) ■ dC(t) . (2.15) 
Jo Jo 

The last term does not contribute to the expectation value due to the martingale property of the Ito 
integral so that 

( Q ) = f'dtf ({VU) ■ M {VU) — k B T (V • M VU)) {t, x) p{t, x) dx , (2.16) 

or, upon integration by parts over space, 

(Q) = J^ dt J (VU -VR)(t,x)-M{VU){t,x) p{t,x) dx (2.17) 

(here and below, we assume that the spatial boundary terms in integration by parts vanish; this is 
assured for confining potentials and fast decaying initial density of the process). 
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The First Law of Thermodynamics, expressing the conservation of energy, takes in the context of 
overdamped Langevin dynamics the form of an identity 



W - Q = AU (2.18) 

where 

AU = U(tf,x(t f )) ~ U(0,x(Q)) (2.19) 

is the difference of the potential energy between the end point and the initial point of the process 
trajectory. Eq. (]2 . 20[) holds for the fluctuating quantities and not only as the relation 

(W) - (Q) = (AU) (2.20) 

for the expectation values with 

(AU) = J U(t f ,x) p f (x) dx - J U(0,x) pi{x) dx, (2.21) 

where pi = p and p f = p tf . 

In [3fj| and [l| it was assumed that at the initial and the final times the potential may undergo jumps 
from Ui(x) to {7(0, x) and from U(tf,x) to Uf(x), leading to the modified expression for the work 

W = U(fi,x(0))-Ui{x(fl)) + f'dtU{t,x(t))dt + U f (x(t f ))-U(t fi x(tf)), (2.22) 

Jo 

with the contributions from the initial and final jumps of the potential included. Of course, Eq. (|2.22[) 
may be obtained from (|2 . 12[) by an appropriate limiting procedure where the jumps are smoothened 
over short initial and final time intervals. Within such a procedure, the process itself is not modified 
in the limit on the time interval [0, tf\ and the limiting heat release is still given by expression (|2.13|) . 
The First Law f|2 . 1 8[) continues to hold, provided we replace formula (|2.19j) for AU by 

AU = U f {x{t } )) - Ui(x(0)) . (2.23) 

The expectation value of work may now be expressed in the form 

(W) = J U f (x) p f (x) dx - J Ui(x) pi(x) dx + (Q) (2.24) 

with the average heat release given by Eq. f|2 . 1 T[) . 

Let us pass to the discussion of the Second Law of Thermodynamics in the context of Langevin 
dynamics (|2.ip (eventual jumps of potential at the ends of the time interval will not affect the formulae 
below). The instantaneous entropy of the system is given by the usual Gibbs-Shannon formula 

S sys {t) = -k B J In(p(t, as)) p(t, x) dx . (2.25) 

For its time derivative, one obtains from the Fokkcr-Planck equation (|2.7|l the expression 
d f 

-^ s sys{t) = -k B I hx{p t (x)){L\pt){x)dx 

= i J R t (x) (V ■ M(VU t ) - V ■ M(VR t ))(x) Pt {x) dx 

= - i J(VR t ){x) ■ M (VU t - VRt)(x) pt(x) dx , (2.26) 

where the last equality follows again by integration by parts. Integrating over time, one gets for the 
change of the entropy of the system in the time interval [0, tf] the formula 

AS sys = S sys (t f ) - S sys (0) = -^J f dtj (VR)(t,x) ■ M (VU -VR)(t,x) p{t.x) dx . (2.27) 
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Since the system evolves interacting with the thermal environment, the entropy of the latter also 
changes. The change of entropy of environment is related to the average heat release by the thermo- 
dynamic formula 

AS env = i(Q>. (2.28) 
For the total entropy production, Eqs. (|2.17|) and (|2.27|l give 



ASfot — AS S y S + AS e 



= ^JJdtj (VU - VR)(t, x) ■ M (VU - VR)(t, x) pit, x) dx 

= ~ J f dt J (v ■ M~ 1 v)(t,x) p(t,x) dx, (2.29) 

where the last line is expressed in terms of the mean local velocity given by Eq. (|2.10j) . Similar formulae 
for the entropy production appeared e.g. in 0, [HI, [2?], [HJ . In the obvious way, identity (|2.29[) implies 
the Second Law of Stochastic Thermodynamics: 

AS to t > (2.30) 

stating that the total entropy production composed of the changes of entropy of the system and of the 
environment has to be non-negative. Inequality (|2.30[) may be also rewritten as a lower bound for the 
average heat release: 

(Q) > -TAS sys . (2.31) 



III. LANDAUER PRINCIPLE 



In the form (12.311) , the Second Law of Stochastic Thermodynamics is closely related to the Landauer 
principle |26| | stating that the erasure of one bit of information during a computation process 
conducted in thermal environment requires a release of heat equal (in average) to at least (ln2)fcsT. 
As an example, consider a bi-stable system that may be in two distinct states and undergoes a process 
that at final time leaves it always in, say, the second of those states. Such a device may be realized 
in the context of Stochastic Thermodynamics by an appropriately designed Langevin evolution that 
starts from the Gibbs state corresponding to a potential with two symmetric wells separated by a high 
barrier and ends in a Gibbs state corresponding to a potential with only one of those wells [lij. The 
change of system entropy in such a process is approximately 

AS sys = - (lnl)fcfl + 2(lni)|fc B = -(ln2)fc B (3.1) 

and Landauer's lower bound for average heat release follows from inequality (|2.3ip . Note that in 
this situation we fix the initial and the final state of Langevin evolution, inquiring how much heat 
is released during a process that interpolates between those states. As is well known, in order to 
saturate the lower bounds (|2.30[) or (|2.31[) , one has to move infinitely slowly so that the system passes 
at intermediate times through a sequence of equilibrium states. Suppose however, that we cannot 
afford to go too slowly. Indeed, in computational devices, we are interested in fast dynamics that 
arrives at the final state quickly but produces as little heat as possible. We are therefore naturally led 
to two questions: 



What is the lower bound for the total entropy production or the average heat release in the 
process that interpolates between given states in a time interval of fixed length? 

What is the dynamical protocol that leads to such a minimal total entropy production or heat 
release? 



These questions make sense in more general setups but we shall study them below in the context 
of Stochastic Thermodynamics of processes described by Langevin equation (|2.1[) . The initial and 
final states will be given by probability densities Pi(x) and Pf(x). The dynamical protocols will be 
determined by specifying for < t < tt a time dependent steering potential U(t, x), that will be called 
the "control" below. In such a setup, the question about the minimum of total entropy production 
or average heat release becomes an optimization problem in Control Theory 115. Il9l| . It was recently 
discussed, together with the optimization of average performed work, in refs. [l|, 



\, see also @, [l8[ . 
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IV. OPTIMAL CONTROL OF ENTROPY PRODUCTION 



We shall describe below a relation of the minimization problem for total entropy production or the 
average heat release to the optimal mass transport [36j and the inviscid Burgers dynamics [10| . To our 
knowledge, such a relation was first established in ref. [l[ using stochastic optimization. Nevertheless, 
connections between stochastic control and (viscous) Burgers equation and between Fokker-Planck 



equation and optimal mass tr ansp ort are old themes, see e.g. Chapter VI of [15j . or [21j in a particular 



case, for the first ones and 24 [ for the second ones. Here, inspired by the discussion in Q, we 



shall minimize the total entropy production given by Eq. (|2.29p by a direct argument in the spirit of 
deterministic optimal control. 

Our strategy is based on the subsequent use of the obvious fact that if a minimizer of a function on 
a bigger set lies in a smaller one then it realizes also the minimum of the function over the smaller set. 
We shall minimize the functional 

A[v, Pi ] = fjjdtj ( v ' M~ x v) (t, x) p(t, x) dx , (4.1) 

where p(t, x) is determined by the advection equation (|2.9p from the initial density pi and the 
velocity field v(t,x), over all velocity fields v under the constraint that p(tf,x) — pf(x). Such an 
extended minimization problem was considered in Q. The crucial but simple additional step will be 
the observation that the optimal velocity field v(t, x) for which the constraint minimum is attained is 
a local mean velocity for a certain control U (t, x). Such an optimal control realizes then the Langevin 
dynamics that interpolates on the time interval [0, tf\ between densities pi and pf with minimal 
total entropy production AStot- 

In [|| , see also [1| , it was shown how one may reduce the constraint minimization of functional (|4.1[) 
to the optimal mass transport problem. Here is a slight modification of that argument. We shall admit 
smooth velocity fields v for which the Lagrangian trajectories x(t) solving the equation 

x(t) = v(t,x(t)), (4.2) 

where the dot stands for i-derivative, do not blow up. E.g., we may take v bounded by a linear 
function of |cc|. The solution of the advection equation (I2.9[) is then given by the formula 

p(t,x) = J 6(x - x(t;xi)) pi(xi) dxi , (4.3) 

where x(t]Xi) denotes the Lagrangian trajectory that passes through Xi at time t — 0. The substi- 
tution of Eq. (I4.3[) into definition (|4.1j) results in the identity 

A[v,pi] = J dt J x(t;xi) ■ M^ 1 x(t;Xi) ptixi) dxi . (4.4) 

Since velocity field v(t,x) may be recovered from its Lagrangian flow x(t;Xi), the minimization of 
A[v, pi] over velocity fields may be replaced by the minimization of the right hand side of f|4.4[) over 
Lagrangian flows such that the map X{ x(tf,Xi) = Xf(xi) is constrained by the condition 



Pf(x) = J S(x - Xf(xi)) pi(xi) dxi , (4.5) 

or, equivalently, denoting by 9 ^g^)^ ^ ne Jacobian of the map x^ H t Xf(x{), by the requirement 
that 

Pf(x f (x i ))^^ = p i (x i ), (4.6) 

In other words, the Lagrangian map Xi \— > xt(xi) should transport the initial density pi into the 
final one p$. Upon exchange of the order of integration, the minimization of functional (|4.4I) may be 
done in three steps: 

• First, we fix a smooth Lagrangian map 

Xi i y x f (xi) (4.7) 
with a smooth inverse Xf i-> Xi(xf) such that constraint (I4.6P holds. 
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• Second, for each a;,, we minimize 

/ x(t;xi) ■ M~ l x(t;Xi) dt (4.8) 
Jo 

over the curves [Q,i/] Bin- x(t;xi) starting from X{ and ending at Xf(xi). Due to the 
positivity of matrix M, the minimal curves are just the straight lines 

tr — t t 

[0,tf]3t i — > x(t;xi) = — Xi + — x f (xi) (4.9) 

*/ */ 

with constant time-derivative x(t;Xi) = Xf(xi) — X{. 

• Third, we minimize the "quadratic cost functional" 

K[xf(-)] = / (xf(xi) - x^ ■ M~ 1 (x f (x i ) - Xi) pi(xi) dxi (4-10) 



over the maps a;, M> Xf(xi) satisfying constraint (|4.6[) . 

In principle, the above three-step minimization is over a broader class of maps x(t;Xi) which might 
be non-invertible for fixed intermediate t, not representing the Lagrangian flow of any velocity field 
v(t,x). As we shall see in the next section, however, the minimizer (|4.9I) represents such a flow if 
Xf{xi) minimizes the cost function (|4.10j) under constraint (|4.6j) . 



V. MONGE-KANTOROVICH MASS TRANSPORT AND BURGERS EQUATION 

The minimization of the quadratic cost function (|4.10l) over invertible Lagrangian maps Xi i— > Xf(xj) 
satisfying constraint (|4. 6[) is the celebrated Monge-Kantorovich optimal mass transport problem |25l . l28| 
related to the inviscid Burgers equation [1, H, Hg|. For reader's convenience, we shall briefly recall that 
relation in the present section. 

Observe that constraint (|4.6|) may be rewritten in the equivalent form in terms of inverse Lagrangian 
maps as the identity 

p f (x f ) = pt(xi(x,)) d[X ^ ] ■ (5.1) 

In the latter form, it implies for the infinitesimal variation 8xi(xf) of the inverse Lagrangian map the 
condition 

dx a Axi) dSx b (x f ) 

Sx t (x f ) ■ (V.Mxtixf)) + (Hixiixf)) ^ f) = 0, (5.2) 

where the 2 nd term comes from the variation of the Jacobian ^gf^jj^-- The last equation may be 
rewritten as a no-divergence requirement: 

Vx, • (pi(xi)5xi(xf(xi))) = 0. (5.3) 

Changing variables in the expression (|4.10[) and using constraint (|5.ip . we may re-express the cost 
function in an equivalent form involving the final density: 



£[ x f(-)} = /(»/- x i( x f)) ■ M 1( y x f - ^i x s) Pf( x f) dx f ■ ( 5 - 4 ) 

The variation of the latter is 

SK.[x f (-)] = 2 J {xi(x f ) - x f ) ■ M^Sxiixf) p f {x f ) dx } 

= 2 J {x l - Xf(xi)) ■ M~ 1 5xi(xf(xi)) pi(xi) dxi . (5.5) 

For the extremal maps Xi n- Xf(xi), variation (15 ,5|) has to vanish for all 5xi(xf(xi)) satisfying (|5.3p . 
This occurs if and only if M~ 1 (x i — Xf{xi)) is a gradient, i.e. if there exists a function F{xj) such 
that 

x f (xi) = MVF(xi). (5.6) 
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Substituting this relation to expression (|4.6[) for the constraint one infers that function F solves the 
Monge- Ampere equation 



'" /U/Vr(;r ' ll,ld f MflC ^ (:Ci) l =/';(*,■) !■'-') 



and, in particular, that 



(in the above relations, the mobility matrix M may be absorbed by the linear change of variables 
x n- x' = \M x). The crucial input from the the theory of Monge-Kantorovich optimal mass 
transport is the result that the minimizer Xi \— > Xf(xi) of the cost function exists and is the unique 
extremum corresponding to a function F which is convex (l7l l36j . Note that it follows then from 
Eq. (|5.8I) that the Hessian matrix of F is everywhere strictly positive. Now, interpolating between 
| Si ■ M _1 Si and function F(xi), set 

Ft{xi) = -^7— Xi ■ M~ l Xi + ^— F(xi) (5.9) 
lt f tf 



for < t < tf. Hence 



tf — t t 

MVFt(xi) = — Xl + —x f {xi) = x(t;xi), (5.10) 



giving the linear interpolation between Xi and as/(asj), just like in (|4.9p . Since 
dx a (t; Xi )^, _ Ajac 8 2 F t _ tj-t 8 2 F 



— ; (as,) = M ac , 1 (xi) = - 1 — -5i + — M ac — -r (x^, (5.11) 

Ox, dx;dx c - tf tf dx", ax c i 



it follows that matrix \M a ^ dx J , equal to the Hessian matrix of Ft, is also everywhere positive 

for the minimizer and even bounded below by the matrix ^^Af -1 . This implies that the map 
Xi 1 — y x(t;Xi) is locally invertible and injective for all t. The latter property is a consequence of the 
"monotonicity" expressed by the inequalities 

(*}-*?) -M-^icfaxJ) -*(*;*?)) 



^ a - xT) wk>^ - s)x * + sxl) {xl " - x?) ds 

> ^ (xl - x?) • M-\x\ - xi) > (5.12) 



which also imply that as(t, as|) has to sweep the whole space when (asj — xf) ■ M^ 1 {x\ — xf) increases 
from zero to infinity. Hence the global invertibility of the maps asj 1— > x(t;Xi). It then makes sense 
to define a function *S>(t, x) by the relation 



L [ ^x ■ M 1 x - x ■ M 1 x i + F t (xi) 



. (5.13) 

x(t;Xi )— x 



Note that the derivative over as, of the term [ • ■ ■ ] on the right hand side vanishes for as(t; as,) = x 
due to Eq. ([5~TU]) . It follows that 

d t y(t,x) = --5(x-x i )-M- 1 {x-x i ), W(t,x) = -M- 1 (x-x i ) (5.14) 

for x(t;Xi) = x. Comparing the last two equations, we infer that function ^(t,x) satisfies the non- 
linear evolution equation 

d t V + - (V#) • M (V#) = (5.15) 

that implies the inviscid Burgers equation (the Euler equation without pressure) 

d t v + (v ■ V)v = (5.16) 
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for the velocity field 



Eqs. (pnUl) and (15T4")) entail that 



v{t,x) = MW(t,x) . (5.17) 



x(t]Xi) = i (xf(xi) - xA = \ (x(t\Xi) - xt) = M (V$)(t,x(t;xi)) = v(t,x(s;x l )) (5.18) 
tf t 

so that the interpolating maps x(t; x) provide the Lagrangian flow of the Burgers velocity field v 
and that the latter is conserved along that flow. This is a general fact: Lagrangian trajectories of a 
velocity field solving the inviscid Burgers equation have constant velocities. 

Let us define the intermediate densities p(t,x) that interpolate over the time interval [0,tf] between 
Pi and pf by Eq. (|4.3I) so that they evolve according to the advection equation (|2.9[) in the Burgers 
velocity field v of Eq. (I5.17[) . It is the assumption that the initial and final densities are smooth that 
assures that such velocities do not involve shocks on the time interval [0,i/]. 

Summarizing the above discussion, we infer that the Burgers velocity field v(t,x) of Eq. (|5.17l) . 
together with the densities p(t,x) of Eq. (|4.3p . minimize functional of Eq. (|4.ip over the 

space of velocities v(t,x) and densities p(t,x) that evolve for < t < tf by the advection equation 
(|2.9I) interpolating between pi and pf. The minimal value of functional ^4[u,/3j] under the above 
constraint is 

Arnin — ~i~rn ^"min > (5.19) 

if 1 

where K. m i n is the value of the quadratic cost function (14. 10)) on the minimizer Xi >->• Xf(x{). These 
are the main results of 0, @, see also Chapter 8 of jl| for more details. That A m in had to be 
inversely proportional to the length of the time interval could have been inferred directly by rescaling 
of time in functional (14.11) 1311 . 



Below, we shall use the following factorization property of the optimal mass transport problem with 
the cost function (|4.10j) holding if the mobility matrix has the block form 



If, with respect to the corresponding decomposition of the d-dimensional space, both initial and final 
densities have the product form: 

Pi (x) = p\{x l ) p 2 {x 2 ) , Pf {x) = p){x l ) p 2 (x 2 ) (5.21) 

for x = (a; 1 , a; 2 ), then the Lagrangian map minimizing cost function (|4.10l) also factorizes into the 
product of minimizers of the lower dimensional problems: 

*/(*() - MVF{xi) = (xj(x}), xj(x})) = (M 1 VF\x}), M 2 VF 2 (xf)) (5.22) 

and the minimal cost is the sum of the lower-dimensional ones. This follows from the uniqueness of the 
minimizer and its characterization in terms of the gradient of a convex function. The corresponding 
Burgers potential ^(t,x) is then the sum, and the interpolating density p(t,x) the product, of the 
ones obtained from the lower dimensional minimizers. 



VI. SECOND LAW OF STOCHASTIC THERMODYNAMICS AT SHORT TIMES 

Let us denote by R(t,x) the dynamic potential related by Eq. (|2.6j) to the optimal densities p(t,x). 
Set 

U(t,x) = R(t,x)-$(t,x), (6.1) 
where <3> is the Burgers potential (|5.13[) . Eq. (|5.17p for the optimal velocity may be rewritten as 

v = MV(R-U) . (6.2) 
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and the advection equation (|2.9p for p becomes 



d t p = -MV(pV(R-U)) = L\p, (6.3) 

where L t is the time-dependent generator (|2.5p for the Langevin process with control U. We infcr 
that the optimal p describes the instantaneous probability densities of such a process with initial 
values distributed with density pi and that the optimal v is its mean local velocity. It follows then 
from relation (|2.29j) that control U provides the optimal protocol on the time interval [0, t/] that 
evolves the initial state pi to the final state pj under the Langevin dynamics (|2.ip with the minimal 
total entropy production equal to A m in of Eq. (|5.19[) . We obtain this way a refinement for finite time 
intervals of the Second Law (|2.30[) of Stochastic Thermodynamics: 



Theorem. For the Langevin dynamics (|2.1|) on the time interval [0,tt] that evolves between states 
Pi and pf, 

AS to t > K-mtn , (6.4) 

with the inequality saturated by the optimal evolution with the time dependent potential 
U (t, x) constructed above. 



Here, as in relation (|2.30[) . AStot — AS sys + AS env denotes the total entropy change, composed of 
the change of entropy of the system AS sys and the change of entropy of the thermal environment 
ASenv — t(Q) during the process. The theorem states that the total change of entropy during 
Langevin evolution (|2.1I) is not smaller than the minimal quadratic cost function (involving the mobility 
matrix M) for the transport of initial probability distribution to the final one, divided by the product 
of time length tf of the process by temperature T of the environment. Since the cost function is 
strictly positive whenever the initial and final probability distributions are different, it follows that 
the shorter the time length of the process and the smaller temperature, the bigger minimal total 
entropy production. The latter may approach zero only for (adiabatically slow) processes taking very 
long time. Inequality (|6.4j) provides then a quantitative refinement of the Second Law of Stochastic 
Thermodynamics (|2.30p for processes whose time span does not exceed tf. In order to determine the 
optimal protocol U(t,x) of Eq. (|6.ip . one has to find subsequently: 

1. the minimizer Xi Xf(xi) — M Vf(x,) of the cost function of Eq. (|4.10p under the constraint 
(|4.6I) such that JC m in — fc[ x f{')]> 

2. the solution given by Eq. (|5.13l) of the Burgers equation (15 . 15[) for potentials; 

3. the solution p given by Eq. (|4.3p of the advection equation (|2.9p in the Burgers velocity field 
v = ¥V*. 



The refined Second Law (|6 .4[) may be rewritten as a refinement of the lower bound (|2 .31[) for the 
heat release in processes with fixed initial and final densities that takes the form 

(Q) > — K-min - T AS S ys ■ (6.5) 

*/ 

and is saturated for the same optimal protocol that the inequality (|6.4p . If one admits initial and final 
jumps of control Ut, as discussed in Sec.|TTl then the problem considered in (II. [30| of minimization 
of average work (|2.24p for fixed initial control Ui, initial density pi, and final control Uf, but for 
arbitrary final density pf, is very closely related to the problem of minimizing the heat release. Indeed, 
we may first minimize ( Q ) for fixed pi and pf and then minimize the right hand side of Eq. (I2.24p 
over pf. This gives the inequality 

(W) > min [1 fC min + I (U f - Rf){x) p f (x) dx] - [(Ui- R t )(x) Pl (x) dx , (6.6) 



PS 



where, as before, fC m i n denotes the minimal value of the cost function (I4.10p for the transport of pi 
to pf. The above bound is saturated for the protocol U(t, x) that minimizes the average heat release 
for the fixed final density pf corresponding to the minimizer of the expression in the square brackets 
on the right hand side. 
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Example. For the Gaussian example (discussed in see also [3(|) with M ab = pS ab , take 



{2naf) d / 2 



exp 



(x - OLi) 



2. 



2^ 



(27R7)) d / 2 



exp 



(x - a/) 5 



2a) 



(6.7) 



corresponding to the system entropy change AS sys = dk B ln(oy/(7,-). The optimal Lagrangian map 
in this case is linear: 



with quadratic function 



Xf(xi) = —{Xi-otij+otf = /jVF «i , 

0"i 



2cr^ v a f " 



Up to a constant, the solution of the Burgers equation (|5.15j) for potential is 



I (V/ - Vi) x2 + (ciO/ - oy«i) • (2a: - at 

tf at \ 



where 



2 /it fa t 



tf-t 



t tf-t t 

Oj + — Of , OL t = — OLi + — OLf 

tf tf tf tf 



(6.9) 



(6.10) 



(6.11) 



interpolate linearly between the limiting values, and the intermediate probability densities become 



p(t,x) 



1 



exp 



(x - at) 2 



2aj 



(2nafy/* 

Up to a time-dependent constant, the optimal control has the form 

k B Tfitf - 0-4(07 - o-j) / k B Tfit f OL t + cr t {a t OL f - 0/Q: 4 )\ 2 



U(t,x) 



2a}[it s 



■(• 



k B T/j,tf - o t {of - Oi) 



The minimal quadratic cost function is 



(a f - arfd + (OLf - on) 2 



.12) 



.13) 



(6.14) 



It determines the minimal total entropy production and minimal average heat release saturating in- 



equalities (|6.4I) and (|6.5p . If, instead of the final density pf, we fix the final control Uf(x) 



(x-a' f ) 2 



admitting its jump at t = tf then the minimum of the average work (|2.24|) is given by the right hand 
side of inequality (I6.6[) . where the minimum over pf is attained on the Gaussian distribution pf of 
Eqs. (HZ) with 



2afoi + ^j{2afa l ) 2 + 4k B Tpt f af{2af + k B Tpt f ) 
af = 2(2af + k B Tpt f ) ' af 



2afa l + k B Tpt fa , f 

2af + k B Tpt f ■ ( ' 



VII. FINITE TIME REFINEMENT OF LANDAUER PRINCIPLE 



The finite time refinement (|6.5p of the lower bound (|2.31[) for the average heat release implies im- 
mediately a refinement of the Landauer bound for the average heat dissipated during the memory 
erasure of one bit of information in Langevin processes for which such erasure is related to the change 
AS sys = — (ln2) k B of the the entropy of the system, see SecQl] The improved bound takes the form 

(Q) > ^IC mm + (ln2)fc B T, (7.1) 

where K m i n is the minimal value of the cost function (|4.10[) . In [l3[, the distribution of the released 
heat (and work) was studied numerically for a particular memory erasure overdamped one-dimensional 
Langevin dynamics. It was checked that the mean heat release ( Q ) satisfied the Landauer bound, 
but that, with small but sizable probability, the fluctuating values of Q may violate the bound. In 
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[8j, heat release was studied in an experimental realization of a similar system undergoing a memory 
erasure dynamics. In the experiment, a silica ball with diameter of 2 pm suspended in a flat horizontal 
cell with ultra pure water at room temperature was manipulated by laser tweezers in order to displace 
the particle localized initially in a double trap to a fixed one of two traps. It was noticed in [8| (in 
Fig. 13) that, for a specific dynamical protocol, the difference between the mean heat release and the 
Landauer lower bound decreased with the time length tt of the erasure process (the decrease seemed 
inversely proportional to i/). In order to see how the optimal protocol for which the upper bound 
in (|7.1I) is saturated looks like in the experimental situation, we considered a 1-dimensional stochastic 

evolution (j2~Tj) with mobility p = °- 213 ^ 77 and the limiting distributions 



P 



>i{x) = i- exp[-^(x 2 -a 2 ) 2 ] = exp[-^^(x)], (7.2) 

Pf( x ) = 17 exp[-^(x-a) 2 ((x-a) 2 + 3a(x-a)+4a 2 )] = exp [ - R f (x)] , (7.3) 

for A — 112 fcgT/im' 4 , a — 0.5 pm, and x expressed in /xm's, see Figs. 1 and 2. The entropy 
difference between p^ and pf is 

AS w - 0.7431204 k B (7.4) 
which is equal to — (ln2)/cs within 7.3%. 
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FIG. 1: pi and pf 
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FIG. 2: Ri and R 



■f 



The experimental situation is close to a two-dimensional one in the horizontal plane, where the 
above initial and final densities in the direction of x-axis are multiplied by the same density 



p(y) 



(7.5) 



in the direction of y-axis, leading to the same entropy difference (|7.4I) . In such a two-dimensional 
situation, however, the Lagrangian map for the optimal mass transport factorizes into the map Xi i— > 
Xf{xi) giving the optimal transport of Pi(x) to p/(x) times the identity map in the y-direction, see the 
end of Sec.[V] The minimal cost for the 2-dimensional problem coincides then with the one for the map 
Xf{xi). The corresponding two-dimensional optimal control is the sum of the optimal control U(t,x) 
for the one-dimensional problem in the ^-direction and of the static potential U(y) = A y 2 (y 2 +4a 2 y 2 ) . 
Consequently, the two-dimensional problem reduces to the one-dimensional one in the direction of the 
x-axis. Similarly, the strong confining potential in the vertical z-direction may be ignored as long as 
it is x- and y-independent. 

We employ three methods to find the optimal Lagrangian map Xi i— > Xf(xi) that transports pi to 
Pf and minimizes the quadratic cost. First, the unique positively oriented map Xi i— > Xf(xi) that 
transports pi to pf may be found from the relation 



Xf {Xi 



pf(x) dx 



Pi{x) dx . 



(7.6) 



According to the general theory exposed in Sec.|Vl it has to minimize the quadratic cost since it is a 
gradient of a convex function. We solve Eq. (|7.6p for Xf(xi) numerically in Scilab, using the j "solve 
procedure, for discrete values of Xi spaced by 5 nm lying in the interval —0.7725 pm < x, < 0.6925 pm. 
This method did not give access to the remaining values of Xi, the numbers involved exceeding there 
the program capacity. Instead, for Xi < —0.7725 pm, the Lagrangian map x\ i-> Xf{xj) was calculated 
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FIG. 3: Lagrangian map x/(xi), its asymptotes and its derivative 



by expanding (xf(xi) — Xi) in powers of (xi — a) 1 up to order 11. The coefficients of the expansion 
were found from the derivative equation 

dxfjxj) = pijxj) . 
dxi pf(x f (x t )) ' 

Similarly, for x > 0.6925 pm, the map Xi i-> Xf(xi) was computed by expanding (x/(xj) — Xi) in 
powers of (xt + a) -1 . Finally, in order to check the above results, in particular around the boundary 
points of the Xi-intervals, where they become less reliable, we performed numerical search for the 
solution of the corresponding optimal assignment problem, usually employed in numerical optimization 
of higher-dimensional mass transport [9J. The task is to find the permutation it of length N that 
induces a bijective map q n x„t n ) between N points ("particles") q n distributed with density pi 
and iV points x n distributed with density pf, minimizing the discretized quadratic cost 

N 

K disc = Y,^{n)-qn)-M- 1 {x lr{n) -q n ) (7.8) 

n=l 

(usually one takes M equal or proportional to the unit matrix). The optimal assignment q n x^i n ) 
gives a discrete approximation to the optimal Lagrangian map Xi h->- Xf(xi). The optimal permutation 
7T may be searched for employing a version of the Auction Algorithm 0], see also Sec. 4 of In our 
one-dimensional simulation, we took N — 10 5 . As an independent check of the method, we also 
performed the two-dimensional simulations with the factor (|7.5[) included in the density, confirming 
the (approximately) factorized form of the resulting optimal assignment. Fig. 3 compiles the results 
for the three methods of computation of the Lagrangian minimizer Xi — > Xf(xi) (the broken curve 
Xi i — y Xi ~\~ a/4 is its exact asymptote at ±oo) and of its derivative. The results agree well in the 
common domains. The green thick dots represent the assignment obtained with the Auction Algorithm. 

Given the optimal Lagrangian map Xf(xi), we put the dynamics into it by interpolation defining 

f -t t 
Xi H 

*/ */ 



x(t;xi) = tf 1 Xi + —Xf(xi). (7.9) 



The corresponding Burgers velocities 



v(t,x) = iiW(t,x) = ^(x f (xi)-Xi) (7.10) 



x(t;Xi)—x 



are plotted in Fig. 4 for tf — Is as function of x at times t = 0, t = tf/2, and t = tf. As we see, 
the evolution of the Burgers velocities that displace the initial distribution to the final one over time 
tf describes a nascent shock. The corresponding dynamic potentials Rt = — ksTYapt are drawn 
on Fig. 5 which also plots the time-dependent optimal controls Uf Note that the initial control Uq 
is different from Ri = Rq, rearranging the symmetric wells by making the right one deeper. The 
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FIG. 6: Burgers velocity at initial, FIG. 7: initial, half-time and final potentials 

half-time and final times, initial, half-time and final controls, 

time window tf = 10s time wind ow t f = 10s 



half-time control U tf /2 moves the left metastable well further to the right. In the final control Ut f , 
the left well disappears altogether. On the other hand, for the time interval 10 times longer, controls 
Ui become close to dynamic potentials Rt, see Figs. 6 and 7 (Ut would coincide with R t for an 
infinitely slow process). 

The quadratic cost function corresponding to the optimal Lagrangian map x, i— > x/(xj) 

^/C mm w 1.996448 s (7.11) 

(the Auction Algorithm produced a value lower by 0.07%, giving an idea about the accuracy of our 
calculations). The minimal average heat release during the process with duration tf = Is is 

( Q )m7n S ~ (1-996448/1 + 0.7431204) k B T w 2.7395684 k B T (7.12) 
whereas for the 10 times longer process 

(Q)Z7n° S ~ (1-996448/10 + 0.7431204) k B T « 0.9427652 k B T . (7.13) 

The average heat release exceeds the Landauer bound (\n2) k B T w 0.6931472 k B T almost 4 times in 
the first case and by about 36% in the second one. 
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VIII. EXTENSION TO NON-CONSERVATIVE FORCES 



The overdamped Langevin dynamics (|2.1[) has the drift given by the gradient of a potential. In the 
presence of non-conservative forces, it should be modified to the stochastic equation 

dx = M(-VU(t,x) + f(t,x))dt + dC(t), (8.1) 

where / represents such forces. We shall keep the noise as before assuming that the environment is 
still thermal and the Einstein relation (|2.3p holds. Eq. (|8.ip defines again a Markov diffusion process 
x(t) with generator 

L t = (-(VU t ) + ft)- MV + k B TV ■ MV . (8.2) 



The Fokker-Planck equation (|2 . T[) still takes the form of the advection equation (|2.9|) in the mean local 
velocity field (12.111) that becomes 

v(t,x) = -M (VIZ + k B Tp- 1 V P )(t,x) = -M{VU -VR- f)(t,x). (8.3) 

The fluctuating heat release is now given by a generalization of formula (|2.13|) : 

rtf 

Q= / (-VU(t,x(t)) + f(t,x(t))) -odx(t). (8.4) 
Jo 



(8.5) 



with the expectation value 

(Q) = J 1 dt J (VU - VR - f)(t, x) ■ M (VU - f)(t, x) p(t, x) dx . 
On the other hand, the change of the entropy of the system takes in the presence of force / the form 

AS sys = -k B J dt J \n(p t (x)) (L\p t )(x) dx 

= -i JJdt J(VR)(t,x)- M(VU -Vi?- f)(t,x) p(t,x) dx . (8.6) 

Defining the entropy change in the environment AS env by the thermodynamic relation (|2.28p . we 
infer that the total entropy production in the time interval [0, tf] is again given by the right hand side 
of Eq. $FM)- 

AStot = AS sys +AS env = ^J^dtJ ( v ' M _1 v) (t, x) p(t, x) dx , (8.7) 

see refs. [ll| or [l^l for the interpretation of AStot as a relative entropy of the processes with direct 
and time-reversed protocols. Eq. (|8.7p implies that the Second Law inequalities (|2.30p and (|2.3ip still 
hold in the presence of non-conservative forces. Recall, that in the previous discussion, we minimized 
the right hand side of the above expression for AStot over all velocity fields with densities p evolving 
by the advection equation (|2.9p between the fixed initial and final ones. Hence the bounds (|6.4p 
and (|6.5p providing a finite-time refinements of the Second Law still hold in the presence of non- 
conservative forces. They are saturated, nevertheless, by the dynamics with a conservative force that 
was constructed before. 

The work performed on the system, admitting the possibility of potential jumps at the end-points 
of the time interval, is defined now by the expression 

W = U(0,x(0)-Ui(x(0)) + f f d t U(t,x(t))dt + Uf(x(tf))-U(tf,x(t f )) 



+ ( * f{t,x{t))-odx{t) = AU + Q, 
Jo 



where AU is given bv Eq. (|2.23p . Hence the minimization of the average work (W) for fixed Ui, pi, 
and Uf may be performed as in Sec. lVIl Consequently, the inequality (I6.6P still holds in the presence 
of non-conservative forces, but it is saturated by the same protocol as before, with a conservative force. 
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IX. CONCLUSIONS 



We have established an exact lower bound (|6.4p for the total entropy production in the overdamped 
Langevin dynamics with thermal noise interpolating in a fixed time window between given statistical 
states with smooth positive probability densities. The bound, realizing a refinement of the Second 
Law (|2.30[) of Stochastic Thermodynamics, is valid in the presence of conservative or non-conservative 
driving forces. It is inversely proportional to the length of the time window and to the temperature. 
The proportionality constant is given by the minimum of the quadratic cost function (|4.10p over all 
maps transporting the initial probability distribution to the final one. The minimal entropy production 
occurs for the process driven by a conservative force with a time-dependent potential expressed by 
solutions of the inviscid Burgers equation related to the optimal Monge-Kantorovich mass transport 
and of the accompanying advection equation for densities. The refined Second Law (|6.4[) induced the 
optimal lower bounds (I6.5[) and (|6.6p for, respectively, the average heat release and average performed 
work. The general theory was illustrated on the example of a Gaussian Langevin process and on 
a model describing a mesoscopic par ticle manipulated by optical tweezers with a memory erasure 
dynamics of the type discussed in [13j as a toy model for Thermodynamics of Computation @. The 
system was recently studied experimentally [8| and we plan to use the outcome of the numerical 
analysis of our model to suggest an improvement of the experimental protocol in order to lower the 
average heat release in the process. 

Our results should have a simple extension to the case with limiting states given by probability 
measures without smooth densities. Such an extension would involve viscosity solutions of the inviscid 
Burgers equation admitting shocks. Applications to cyclic processes (e.g. to models of molecular 
motors and to optimization of their efficiency is among natural directions of further research, see [3lj 
and the references therein. A more difficult problem requiring limiting arguments is an extension 
of the above results to the case of underdamped Langevin dynamics. A related discussion of work 
minimization in the Gaussian case may be found in [18|. Another step in that direction was taken 
recently in In general, the question about the minimal entropy production in finite time processes 
between fixed states makes sense for more general modelizations of non-equilibrium dynamics, e.g. for 
the ones involving thermostats. It is certainly worth studying in such contexts. Other optimization 
problems of deterministic or stochastic nature related to fluctuation relations in non-equilibrium sta- 
tistical mechanics may also be interesting [l[ . The optimization techniques [H, [l5[ developed largely 
with an eye on other cost functions, seem to find this way new important applications. 
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